Skip to content

Python: support (Azure) OpenAI realtime audio models #13291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Python: support (Azure) OpenAI realtime audio models #13291

wants to merge 4 commits into from

Conversation

@moonbox3
Copy link
Collaborator

@moonbox3 moonbox3 commented Oct 24, 2025 •
edited
Loading

Motivation and Context

SK has support for realtime-preview models; however, since they've gone to GA we have not added support for the latest library abstractions. This PR brings in the changes to support running models like gpt-realtime, gpt-realtime-mini or gpt-audio.

Description

Contribution Checklist

@moonbox3 moonbox3 self-assigned this Oct 24, 2025
@moonbox3 moonbox3 requested a review from a team as a code owner October 24, 2025 04:14
@markwallace-microsoft markwallace-microsoft added the python Pull requests for the Python Semantic Kernel label Oct 24, 2025
@markwallace-microsoft
Copy link
Member

markwallace-microsoft commented Oct 24, 2025

Python Test Coverage

Python Test Coverage Report •
FileStmtsMissCoverMissing
connectors/ai/open_ai/prompt_execution_settings
   open_ai_realtime_execution_settings.py52786%99, 103, 107, 111, 115, 119, 123
connectors/ai/open_ai/services
   _open_ai_realtime.py45710177%288, 290, 292, 316, 378, 386, 430–434, 458–461, 552–553, 556–557, 567, 575–578, 585, 587, 590–591, 641–644, 653–656, 668–669, 713–715, 717–718, 721–722, 725, 736, 739, 741–743, 745–747, 786–787, 794–796, 815, 822, 827–829, 831–834, 841–843, 851–852, 856–860, 873–874, 879–881, 913, 916, 919–922, 927–929, 932–935, 937–941
   azure_realtime.py612952%104–105, 115–119, 140, 212–213, 223–230, 250, 255, 259–260, 267, 278–283
connectors/ai/open_ai/settings
   open_ai_settings.py150100% 
TOTAL27331458083% 

Python Unit Test Overview

Tests Skipped Failures Errors Time
3759 23 💤 0 ❌ 0 🔥 1m 39s ⏱️

@moonbox3 moonbox3 added the PR: breaking change Pull requests that introduce breaking changes label Oct 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@moonbox3 moonbox3

Labels

PR: breaking change Pull requests that introduce breaking changes python Pull requests for the Python Semantic Kernel

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Python: Bug: Python - Semantic Kernel Realtime isn't supporting the GA versions of Azure OpenAI realtime models

2 participants

@moonbox3 @markwallace-microsoft